Occupancy of phase space, extensivity of S q , and g-generalized central limit theorem 
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Increasing the number N of elements of a system typically makes the entropy to increase. The 
question arises on what particular entropic form we have in mind and how it increases with N. 
Thermodynamically speaking it makes sense to choose an entropy which increases linearly with 
N for large N, i.e., which is extensive. If the N elements are probabilistically independent (no 
interactions) or quasi-independent (e.g., short-range interacting), it is known that the entropy which 
is extensive is that of Boltzmann-Gibbs-Shannon, Sbg = —k~}2 i=1 pi\npi. If they are however 
globally correlated (e.g., through long-range interactions), the answer depends on the particular 
nature of the correlations. There is a large class of correlations (in one way or another related to scale- 
invariance) for which an appropriate entropy is that on which nonextensive statistical mechanics is 

based, i.e., S q = k 1 ^l^ 1 Pi (Si = Sbg), where q is determined by the specific correlations. We 
briefly review and illustrate these ideas through simple examples of occupation of phase space. A 
very similar scenario emerges with regard to the central limit theorem (CLT). If the variables that 
are being summed are independent (or quasi- independent, in the sense that they gradually become 
independent if N — > oo), two basic possibilities exist: if the variance of the random variables that are 
being composed is finite, the N — > oo attractor in the space of distributions is a Gaussian, whereas 
if it diverges, it is a Levy distribution. If the variables that are being summed are however globally 
correlated, there is no reason to expect the usual CLT's to hold. The N — > oo attractor is expected to 
depend on the nature of the correlations. That class of correlations (or part of it) that makes S q to 
be extensive for q ^ 1 is expected to have a g e -Gaussian as its N — > oo attractor, where q e depends 
on q [q e (q) such that q e (l) = 1], and where q e -Gaussians are proportional to [1 — (1 — q e )[3 x 2 ] 1 ^ 1 ~ qc * 1 
(P > 0; q e < 3). We present some numerical indications along these lines. The full clarification of 
such a possible connection would have considerable interest: it would help qualifying the class of 
systems for which the nonextensive statistical concepts are applicable, and, concomitantly, it would 
enlighten the reason for which g-exponentials are ubiquitous in many natural and artificial systems. 
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A surface is a geometric object which has a finite mea- 
sure for dimensionality d = 2, zero measure for any d > 2, 
and infinite measure for any d < 2. A fractal has a finite 
measure only for d = df, where the fractal dimension df 
is some real number, zero measure for d > df, and infi- 
nite measure for d < df. Generically df is a noninteger 
number (an exception is constituted by the so called fat 
fractals, which have an integer df). For example, a tri- 
adic Cantor set constructed on a segment of length 10 cm 
has a measure of 10 df cm df with df — In2/ln3 = 0.63..., 
i.e., 4.27 cm 063 . 

In total analogy with the above, an entropy S is said 
extensive if liniAr^oo S(N)/N is finite. Let us focus on 
the basis of nonextensive statistical mechanics Q (see 
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with S\ = Sbg = — ^X)j=iPi m Pi' There are systems, 
constituted by A" elements, whose probabilistic sets are 
such that liniN—joo Sq(N)/N is finite for q = q sen , van- 
ishes for q > qsen, and diverges for q < q sen (sen stands 
for sensitivity: see 0,0] and references therein). We shall 
here illustrate both normal (i.e., q sen = 1) and anomalous 
(i.e., q sen ^ 1) systems. 

Let us consider A^ distinguishable binary random vari- 
ables whose joint probabilities are denoted by {pf,P2} = 
{ P ,l-P} for N = l, {p^ B \pf 2 +B ,p* +B ,p£ B } (with 
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P22 B = 1) for AT = 2, and 
so on. See Table I for A" = 3. For arbitrary A^ we 
will have a A^-dimensional hypercube within which we 
can represent the associated W = 2 N joint probabilities. 
The N = 2 marginal probabilities are given by pf — 

n A + B + n A+B fi A - n A+B 4- n A+B n B - n A+B 4- n A+B 
Pll + Pl2 1 Pi ~ P21 +P22 1 Pi — Pll +-P21 , 

and p B = p A 2 +B + P22 +B ■ Analogously we can construct 
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the marginal probabilities associated with arbitrary N. 
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TABLE I: Joint probabilities associated with A = 3, the sub- 
systems being A, B and C. The probabilities out of and 
within brakets respectively correspond to states 1 and 2 of 
subsystem C. It is p?+ B + c +p? 1 + 2 B+C +pf£ B+C +P^ S+C + 

A+B+C , A+B+C , A+B+C , A+B+C _ i 
P211 ' P212 ' P221 ' P222 — 



Let us introduce now an important notion, namely 
scale-invariance, basis of techniques such as renormal- 
ization group |fj. We shall say that our system is scale- 
invariant if the marginal probabilities of the N- system 
coincide with the joint probabilities of the (N — 1)- sys- 
tem, \/N. This strong property implies, for instance, that 
Pi = Pi, P2 = P2, Pi = Pi, and p$ = p B . 

Let us also introduce a symmetry property, namely 
commutativity. A iV-system will be said commuta- 
tive if we can freely interchange its subsystems for ev- 
ery specific A-state. This property implies, for in- 



stance, that Pi2 B 
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for N = 2, and pf£ B+c 



for N = 3. 
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p£+ h for 

P^ B+U or p?+ B+C = 
3. If a system is commutative 
for all N, it admits a representation simpler that the 
Af-dimensional hypercubes mentioned before. It ad- 
mits, more precisely, a triangular representation as in- 
dicated in Table II, with the convention (720, f*2i, ?"22) = 
iPll B ,Pi2 B ,P22 B ) ^ TV = 2, (r 30 ,r 31 ,r 32 ,r 33 ) = 
^i\ B+C ,P^2 + i B+C ,P^2 B+C ,Pp2 B+C ) for N = 3, and so 
on for increasing N . Probability normalization implies 
of course 



N = 2, nor pf£ B+C 
pi+ B+c ior N 
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r Nn = l (VAT) 



(2) 



(1,1) 
(1,7-10) (i,m) 

(l,r 20 ) (2,rai) (l,r 22 ) 
(l,r 30 ) (3,r 3 i) (3,r 32 ) (l,r 33 ) 
(l,r 40 ) (4, r 4 i) (6,r 42 ) (4, r 43 ) (l,r 44 ) 



(N = 0) 
(A = l) 
(A — 2) 
(A — 3) 
(A = 4) 

TABLE II: Most general form of a commutative system com- 
posed by binary random variables. The left (right) component 
of each couple corresponds to the Pascal triangle element (the 
probability) . 
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Scale-invariance and commutativity are totally inde- 
pendent properties. If they are, however, simultaneously 



FIG. 1: S q (N) for (a) the Leibnitz triangle, (b) p = 1/2 

independent subsystems, and (c) rjv.o = (1/2)" . Only for 
q — 1 we have a finite value for limjv^oo S q (N)/N; it vanishes 
(diverges) for q > 1 (q < 1). 
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satisfied, then the system can be represented as in Table 
II with the following supplementary property: 



TN.n + rjv,™+i = Hy-l, 



(3) 



This property is from now on referred to as the "Leib- 
nitz rule" [J H, @ • Indeed, it is satisfied by the cele- 
brated Leibnitz triangle • The Leibnitz rule goes "up- 
wards" , in contrast with the Pascal triangle rule, which 
goes "downwards" . A triangle such as that of Table II, 
and also satisfying Leibnitz rule, is fully determined by 
giving one probability for each value of TV, e.g., by giv- 
ing {r^vo} (VAT). Leibnitz triangle itself is entirely deter- 
mined by r^o — + 1) (hence rjvn ~ — ! — l X ' 
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Let us now give three q sen — 1 examples, all of them 
satisfying Leibnitz rule. They are indicated in Fig. 1, and 
correspond to the Leibnitz triangle itself, TV independent 
binary random variables (i.e., rjvo = p N , hence rjvn = 
P n (l—p) n with <p < 1), and a streched- exponential 
system respectively. Both the Leibnitz triangle and the 
streched-exponential system involve correlations, but not 
global enough to take the system out from the q sen = 1 
universality class. In other words, the entropy which is 
extensive is Sbg, the Boltzmann-Gibbs one . 

Let us finally illustrate the q sen ^ 1 case with a trian- 
gle in which most states have zero probability. Only a 
(left-side) strip whose width is d+1 (d = 1, 2, ...) has non- 
vanishing probabilities (see details in 0). The number 
of states with nonvanishing probabilities increases like a 
power of TV, whereas the total number of states increases 
like 2^. The d = 1,2 instances are presented in Table 
III. The entropies of the d — 1,2,3 instances are shown 
in Fig. 2. The correlations are now global enough to 
drive the system out of the q sen = 1 universality class. 
The entropy which is extensive now is Si_(i/d). 



(N = 0) (1,1) 

(iV = l) (1,1/2) (1,1/2) 

(TV = 2) (1,1/2) (2,1/4) (1,0) 

(TV = 3) (1,1/2) (3,1/6) (3,0) (1,0) 

(TV = 4) (1,1/2) (4,1/8) (6,0) (4,0) (1,0) 

(TV = 0) (1,1) 

(TV = 1) (1,1/2) (1,1/2) 

(TV = 2) (1,1/3) (2,1/6) (1,1/3) 

(TV = 3) (1,3/8) (3,5/48) (3,5/48) (1,0) 

(TV = 4) (l,2/5)(4,3/40)(6,3/60) (4,0) (1,0) 

TABLE III: Anomalous probability sets: d = 1 (top), and d — 
2 (bottom). They satisfy the Leibnitz rule only asymptotically, 
i.e., for TV — » oo. 
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FIG. 2: S q (N) for anomalous systems: (a) d = 1, (b) d = 2, 
and (c) d — 3. Only for q = 1 — (1/d) we have a finite value 
for limjv^oo S q (N)/N; it vanishes (diverges) for q > 1 + (1/d) 
( 9 <l + (l/d)). 
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ON A g-GENERALIZED CENTRAL LIMIT 
THEOREM 



Let us consider the following generalized Fokk 
Planck equation: 



d P (x,t) _ D d-<[ P {x,t)f- 



ot 



d\i 



(0 < 7 < 2; q e < 3) 



The diffusion coefficient D can always be englobed wit] 
time t. Consequently, this equation is essentially char 
terized by only two parameters, namely 7 and q e : ; 
Fig. 3. 

If (q e ,j) = (1,2), we have the celebrated Fourier hi 
equation, and the exact solution (assuming p(x, 0) 
(5(0)) is a Gaussian. This point of Fig. 3 is to be 
sociated with the standard or Gaussian Central Lir 
Theorem (G — CLT). Within this theorem one essi 
tially considers the sum of N independent random vari- 
ables, each of them satisfying a probability distribution 
whose variance is finite. Then the N — > 00 attractor in 
the space of the distributions is, after appropriate scal- 
ing, a Gaussian distribution. N plays in the theorem the 
same role as t in Eq. (4). 

If q e = 1 and < 7 < 2, we still have a linear equation 
whose exact solution (assuming p(x, 0) = (5(0)) is a Levy 
distribution the index of which coincides with 7. This 
line of Fig. 3 is to be associated with the Levy-Gnedenko 
CLT (L — CLT). Within this theorem, once again one 
considers the sum of N independent random variables, 
each of them satisfying a probability distribution whose 
variance now diverges. Then the N — > 00 attractor in the 
space of the distributions is, after appropriate scaling, a 
Levy distribution. 

These two theorems basically cover all possible situ- 
ations whenever the random variables are independent. 
The situation might change dramatically if the N vari- 
ables are collectively correlated for all values of TV, even 
when N diverges. One such case is the one indicated in 
Fig. 3 by the 7 = 2 line with q e =/= 1. The equation is 
then nonlinear, and its exact solution [l3l.ll4| (assuming 
p(x,0) = (5(0)) is a q e — Gaussian (this name denotes 
the distributions that are proportional to e~ with 

and e? 



B > 0, where e x = [1 + (1 - q e ) x] 



1/(1-9.) 



e»); 



normalizability of the distribution imposes q e < 3; the 
second moment is finite for q e < 5/3, and diverges for 
5/3 < q e < 3. We expect this family of solutions (quite 
common indeed for certain classes of complex systems) to 
correspond to some form of generalized CLT (from now 
referred to as q — CLT). In other words, we expect that 
a certain class of globally correlated systems would have 
as their N — > 00 attractor, and after some appropriate 
scaling, precisely a g e -Gaussian. 

The CLT and its possible extensions have a long and 
fascinating history, clearly justified by the crucial role 
this theorem plays in theory of probabilities, statistical 
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FIG. 3: Localization in the (g e , 7)-space of the standard 
and Levy-Gnedenko CLT's, as well as of the conjectural q- 
generalized CLT (based on |2^|. The schematic dashed lines 
are curves that share the same exponent of the power-law be- 
havior that emerges in the limit \x\ — > 00. At the q e — 1 
axis we have Levy distributions which asymptotically decay 
as l/|s| 1+7 , and at the 7 = 2 axis we have g e -Gaussians which 
decay as l/|a;| 2 ' W e- -0. The connection is therefore given by 
Qe = (7 + 3)/(l+ 1) for 2 > 7 > 0, hence 5/3 < q e < 3 (see 
based on (l^l l. For instance, the dashed line which joins 
the (<? e , 7) points (1, 1) and (2, 2) schematically indicates those 
solutions of Eq. (4) which asymptotically decay as 1/x 2 , and 
the dashed line joining (1, 1/2) and (7/3, 2) indicates those so- 
lutions which decay as 1/ 1 as | 3 / 2 . The dot slightly to the right 
of the point (5/3, 2) is joint to the point slightly below (1, 2). 



mechanics, and elsewhere. In some sense it all started 
with A. de Moivre, who in 1733 obtained (apparently 
for the first time |l5j) the normal distribution in con- 
nection with the binomial distribution, Pascal triangle 
and alike. It continued with P.S. de Laplace, who reob- 
tained the normal distribution in 1774, and then with R. 
Adrain in 1808. Finally, in 1809 C.F. Gauss published 
his celebrated formalization of the theory of errors. It is 
presumably because of this achievement that it became 
to be known nowadays as Gaussian. In the 1930's, P. 
Levy and B.V. Gnedenko developed the extended theo- 
rem yielding Levy distributions. Many studies have been 
dedicated to variations of these theorems. Efforts have 
been also done addressing the influence of correlations 
(e.g., 0|), and reviews are available (see 0, 0] and 
references therein). 

The possibility of existence of a generalized CLT 
whose attractors would be g-Gaussians was considered in 
E3, E3, EI ■ Such a possibility was addressed in detail in 
[22J . in particular in connection with deformed products 
|i! IH El miH]. The same tneorem was essentially ad- 
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dressed in 23] in terms of stochastic processes. A related 
theorem, also based in deformed products, was recently 
presented as well [29j. 

We focus now onto some recent numerical indications 
[3fl l3~i| suggesting the existence of the g e -Gaussian at- 
tractors, at least for the q e < 1 branch of the 7 = 2 line 
of Fig. 3. More precisely, we are going to generalize the 
binomial distribution by introducing a global correlation 
(between N random variables) through a specific scale- 
invariant procedure. We then check what is the N —> 00 
attractor. The absence of such correlations will provide 
a Gaussian attractor [q e — 1), which is usually referred 
to as the de Moivre-Laplace theorem. In other words, we 
intend to generalize here that theorem in the presence of 
a specific classs of global correlations. We follow [30|. 

We consider again the N distinguishable binary vari- 
ables that were introduced previously (see Table II). 
They can be associated with a row of a triangle of prob- 
abilities {rN,n} [n = 0, 1,2, —,N) that satisfy Eq. (2). 
Once again we shall impose Leibnitz rule 0,0, i.e., Eq. 
(3). We remind that this rule is a specific form of scale- 
invariance which guarantees that the marginal probabili- 
ties of the N- system coincide with the joint probabilities 
of the (N — 1)- system. The probabilistic system is fully 
determined if we also provide one clement of each row of 
the triangle, say {tn,o} (ViV). If we impose rjv o = P N 
with < p < 1, we precisely recover the binomial dis- 
tribution, which leads to the de Moivre-Laplace theo- 
rem. We shall impose a global correlation by using the 
g-product 26] defined as follows: 



x® q y = [x 1 q - 



y 



i-<? _ 111/(1-9) 



(x,y > l;q< 1). (5) 



This generalised product has the following properties: (i) 
x®\y = xy; (ii) x® q l = x; (hi) \n q (x® q y) = \n q x+\n q y, 
with ln g x = - 1 _ q 1 (lni % = lax) being the inverse of e x q \ 
( iv ) ^WH = (x) ®2- 9 If the probability distribution 



qy -y x r^2- qyy 
in phase space is uniform within a volume W , the entropy 
S q is given by S q = ln 9 W. Property (iii) can then be in- 
terpreted as S q (A + B) = S q {A) + S q (B) where A and 
B are subsystems that are not independent but rather 
satisfy Wa+b — Wa ® q Wb- The possibility of a cor- 
respondence between this a — product with a g-CLT has 
already been conjectured [22j, and some efforts along this 
line already exist in the literature |27|. 

The global correlation is introduced by imposing 



(lAiV.o) - (1/p) ®g (1/P) ®g [XI P) ®q 

hence 



TN,0 = P®2~qP®2-qP®2-q ■ ■ - ®2-qP 

= 1/ [Np 11 - 1 - (N - l)] 1 ^ 1 '^. 



For < p < 1 we see that rjv.o = 
if q = 1, whereas rjv.o " ' 
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FIG. 4: ln_ 



-4/3 g§y vs x 2 for (q,p) = (3/10, 1/2), and N = 
200. Two branches are observed due to the asymmetry emerg- 
ing from the fact that we have imposed the q-product on the 
"left" side of the triangle; we could have done otherwise. The 
mean value of the two branches is indicated in dashed line. It 
is through this mean line that we have numerically calculated 
q e (q) as indicated in Fig. 5. Inset: Linear-linear representa- 
tion of p(x). 
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FIG. 5: ln_ 4/3 ^ vs x 2 for (q,p) = (3/10, 1/2) and various 
system sizes N. Inset: ^-dependence of the (negative) slopes 
of the ln ge vs x 2 straight lines. We find that, for p = 1/2 and 
N » 1, <(n- (n>) 2 } ~ N 2 /P(N) ~ a{q)N + b{q)N 2 . For 
(l/p) , (6) q = 1 we find a(l) = 1 and 6(1) = 0, consistent with normal 
diffusion as expected. For q < 1 we find a(q) > and 6(g) > 0, 
thus yielding ballistic diffusion. The linear correlation factor 
of the q — log versus x 2 curves range from 0.999968 up to near 
0.999971 when N increases from 50 to 1000. The very slight 
lack of linerarity that is observed is expected to vanish in 
IG the limit N —> 00, but at the present stage this remains a 
numerically open question. 
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FIG. 6: Relation between the index q from the g-product 
definition, and the index q e resulting from the numerically 
calculated probability distribution. The agreement with the 
analytical conjecture q e = 2 — 1 is remarkable. Inset: Detail 
for the range < q e < 1. 

l/jVV(i-«) (AT _> oo) for q < 1. We shall from now 
on focus on p = 1/2, and < q < 1. We can check 
that 9=1 recovers the triangle on which de Moivre and 
Laplace based their historic theorem. We can also check 
that q = yields rn n = l/(iV + 1), i.e., we recover the 
Leibnitz triangle |l0|. 

By introducing a conveniently centered and rescaled 
variable, namely x = ^~jy72 > we can cnec k that, for 
increasing N, our set of probabilities approaches (see 
Figs. 4 and 5) a double-branched (? e -Gaussian proba- 
bility p(x) oc e~j 3x with 

qe = 2 - - . (8) 

See Fig. 6. We verify that q — 1, hence q e = 1, repro- 
duces the de Moivre-Laplace theorem. For q decreasing 
from unity to zero, q e decreases from unity to minus in- 
finity. By double-branched we mean that what we get is 
two branches of qt-Gaussian with slightly different coeffi- 
cients (3 on the right and left sides of it. This asymmetry 
comes from the fact that we have introduced the correla- 
tions by imposing Leibnitz rule on the "left" side of the 
triangle, not, for instance, at its center. 

Transformation (8) is a composition of multiplicative 
duality {q «-> 1/q, whose fixed point is q = 1), and additive 
duality (q <-> 2 — q, whose fixed point once again is q = 1). 
These two transformations, alone or combined, appear 
in fact very frequently in the literature of nonextensive 
statistical mechanics. 

3 - CONCLUSIONS 

It is well known that, if we have a system constituted 
by N elements that are (either exactly or nearly exactly) 



independent in the probabilistic sense, then (i) the en- 
tropy which is extensive is Sbg(N), and (ii) the attrac- 
tor, in the sense of a central limit theorem, is a Gaussian 
(Levy) distribution if the variance of the single distribu- 
tion that is being convoluted is finite (infinity). 

We have shown here that special global correla- 
tions (which are either exactly or asymptotically scale- 
invariant) among these N elements can make that (i) the 
value of q for which S q (N) is extensive differs from unity, 
and (ii) the attractor, in the sense of a central limit the- 
orem, not only differs from both a Gaussian or a Levy 
distribution, but can even precisely be a (/-Gaussian dis- 
tribution (which in fact extremizes S q under appropriate 
constraints). 

It remains as an important open question the under- 
standing of what are the precise classes of global corre- 
lations that induce one or the other of these anomalies. 
It is in principle possible that one of these two classes 
contains the other one, or that none of them fully con- 
tains the other one, having nevertheless a nontrivial in- 
tersection. Or even — the simplest of all possibilities — 
they could coincide. If they do, is it (asymptotic) scale- 
invariance a sufficient and necessary condition for both 
anomalies to emerge simultaneously? The exact answer 
to this and related questions would deeply enlighten the 
reason for which (/-exponentials appear so frequently in 
many natural and artificial systems. It would of course 
also qualify the classes of situations for which the con- 
cepts emerging in nonextensive statistical mechanics (and 
in its generalizations and its variations) are applicable. 
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